18.05 Lecture 21 
April 1, 2005 



Normal Distribution 

Standard Normal Distribution, N(0, 1) 
p.d.f.: 



m.g.f.: 



-x 2 /2 
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<f>(t) = E(e tx ) = e' 2 / 2 
Proof - Simplify integral by completing the square: 

0( t ) = / e tx -±= e~ x2 ' 2 dx = I e tx ~ x2 / 2 dx = 
J V2^ V2W 

i [ e t>,2-t>/2 +tx - x > / 2 dx = i e * 2 / 2 f e -w-*r dx 

V2^J V^K J 

Then, perform the change of variables y = x - t: 

1 /*°° i z* 00 r 

= J—e^l 2 \ e^dy = e t2 ' 2 ^= / dy = e 1 " I 2 / f(x)dx - e 4 ^ 2 



Use the m.g.f. to find expectation of X and X 2 and therefore Var(Y): 

E(X) = cf> , (0)=te t2 / 2 \ t=0 = 0:E(X 2 ) = 0"(O) = e^ 2 * 2 + e t2/2 | t=0 = l;Var(X) = 1 
Consider X - N(0, 1), F = aX + ^, find the distribution of Y: 



p.d.f. of Y: 



¥(Y <y) = P(aX + ft < y) = ¥(X < V - — ^) 

a 



„, . d¥(Y < y) 1 («-m) 2 1 1 (y-M) 2 



2tt 



2 / 2 da 



dy V^tt" ct <jV2tt 

EY = E(aX + n) = ct(0) + ^(1) = n 

E(Y - jjl) 2 =E (aX + fi-fi) 2 = a 2 E{X 2 ) = a 2 - variance of N{ji, a) 
a = ^/Var(Y) - standard deviation 



N(ji,v) 
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To describe an altered standard normal distribution N(0, 1) to a normal distribution N(/j,, a), 
The peak is located at the new mean ji, and the point of inflection occurs a away from \i 




1 1 1 

fi-o fi fi + a 



Moment Generating Function of N(fj,, a); 

Y = aX + [i 

4>{t) = Ee tY = Ee^ x+ ^ = Ee^ x e^ = e^Ee^ x = e^e^' 2 = e ^+*» 2 /2 

Note: X\ ~ N(fi\,ai), X n <~ N(fi n ,a n ) - independent. 

Y = X x + ... + X n , distribution of Y: 
Use moment generating function: 

Ee tY = Ee*(*i+-+*») = Ee tXl ...e tx " = Ee tXl ...Ee tx » = e" 1 ^/ 2 x ... x e ^*+"»* 2 / 2 

The sum of different normal distributions is still normal! 

This is not always true for other distributions (such as exponential) 

Example: 

X <~ N(fi, a), Y — cX, find that the distribution is still normal: 

Y = c(aN(0, 1) + n) = (ca)N(0, 1) + {pc) 

Y ~ cN(fi,a) = N(cfi,C(r) 

Example: 
Y~N(p,a) 

P(a < Y < b) = P(a < ax + p < b) = P(^ < X < ^) 
This indicates the new limits for the standard normal. 

Example: 

Suppose that the heights of women: X ~ A?" (65, 1) and men: Y ~ iV(68, 2) 
P(randomly chosen woman taller than randomly chosen man) 

V(X > Y) = F(X - Y > 0) 

Z = X - Y ~ 7V(65 - 68, Vl 2 + 2 2 ) = N(-3, y/{5)) 

¥(Z > 0) = P( Z ~J- 3) > = P(standard normal > = 1.342) = 0.09 

Probability values tabulated in the back of the textbook. 

Central Limit Theorem 

Flip 100 coins, expect 50 tails, somewhere 45-50 is considered typical. 
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Flip 10,000 coins, expect 5,000 tails, and the deviation can be larger, 
perhaps 4,950-5,050 is typical. 

Xi = {l(tail);0(head)} 

number of tails = X 1 + ...+X n ^ = 1 = 1 _ 1 = 1 

n n 1 ' 2 y V ' 2 V 2 1 4 

But, how do you describe the deviations? 
Xi,X 2 , — ,X n are independent with some distribution P 



1 ™ 

A t = EX 1 ,cr 2 = V&r(X 1 );x = - ^ X, -> EXi = 

n i=i 



i-/ion the order of -^/n — > ^ behaves like standard normal. 



is approximately standard normal iV(0, 1) for large n 



p( - V^Of — AO < x ^ n ^ > ) p( st andard normal < x) = N(0, l)(-oo,x) 
a 

This is useful in terms of statistics to describe outcomes as likely or unlikely in an experiment. 
P(numbcr of tails < 4900) = P(Xi + ... + Xi , oo < 4, 900) = P(x < 0.49) = 

= p( VID^(x-l) < yiQ^(0.49-0. 5)) ^ ^ _ 100(0.01) = _ 2) = Q ^ 

2 2 2 



Tabulated values always give for positive X, area to the left. 
In the table, look up -2 by finding the value for 2 and taking the complement. 
** End of Lecture 21 
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